Papers with prompt chaining
ReEval: Automatic Hallucination Evaluation for Retrieval-Augmented Large Language Models via Transferable Adversarial Attacks (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing static benchmarks do not guarantee that models can use the provided evidence for answering, which is essential to avoid hallucination when the required knowledge is new or private. |
| Approach: | They propose to automatically perturb existing static one for dynamic evaluation by using a chatGPT framework and a set of open-domain QA datasets. |
| Outcome: | The proposed framework generates new test cases on two open-domain QA datasets and is human-readable and useful to trigger hallucination in LLMs. |
It’s All About the Confidence: An Unsupervised Approach for Multilingual Historical Entity Linking using Large Language Models (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing approaches to EL for historical texts require substantial training data or rely on domain-specific rules that limit scalability. |
| Approach: | They propose an unsupervised ensemble approach combining a Small Language Model and an LLM for historical EL. |
| Outcome: | The proposed approach outperforms state-of-the-art models on four established benchmarks in six European languages from the 19th and 20th centuries. |